Semidefinite programs (SDPs) are powerful theoretical tools that have beenstudied for over two decades, but their practical use remains limited due tocomputational difficulties in solving large-scale, realistic-sized problems. Inthis paper, we describe a modified interior-point method for the efficientsolution of large-and-sparse low-rank SDPs, which finds applications in graphtheory, approximation theory, control theory, sum-of-squares, etc. Given thatthe problem data is large-and-sparse, conjugate gradients (CG) can be used toavoid forming, storing, and factoring the large and fully-dense interior-pointHessian matrix, but the resulting convergence rate is usually slow due toill-conditioning. Our central insight is that, for a rank-$k$, size-$n$ SDP,the Hessian matrix is ill-conditioned only due to a rank-$nk$ perturbation,which can be explicitly computed using a size-$n$ eigendecomposition. Weconstruct a preconditioner to "correct" the low-rank perturbation, therebyallowing preconditioned CG to solve the Hessian equation in a few tens ofiterations. This modification is incorporated within SeDuMi, and used to reducethe solution time and memory requirements of large-scale matrix-completionproblems by several orders of magnitude.
展开▼
机译:半定型程序(SDP)是功能强大的理论工具,已经研究了二十多年,但是由于解决大型,现实问题的计算困难,它们的实际应用仍然受到限制。在本文中,我们描述了一种改进的内点方法,用于有效解决大型稀疏低秩SDP,该方法在图论,逼近理论,控制理论,平方和等方面都有应用。假定问题数据为大而稀疏的共轭梯度(CG)可以用来避免形成,存储和分解大而全密的内点Hessian矩阵,但是由于条件不佳,导致收敛速度通常很慢。我们的主要见解是,对于秩为$ k $,大小为$ n $的SDP,Hessian矩阵仅因秩为$ nk $的扰动而处于病态,可以使用大小为$ n的显式计算本征分解。我们构造了一个预处理器来“校正”低秩扰动,从而允许预处理的CG在几十次迭代中求解Hessian方程。此修改已合并到SeDuMi中,用于将解决方案时间和大规模矩阵完成问题的内存需求减少几个数量级。
展开▼